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1 • Introduction 

The  general  quadratic  programming  problem  is 


minimize: 


1 

1 X Dx 

2 


T 

c X 


subject  to:  Ax  ^ b 


(1) 


In  [5],  Eaves  describes  a procedure  that  in  a finite  number  of 
steps,  determines  either  the  global  minimum  of  (1)  or  a halfline  of  the 
constraint  set  along  which  the  minlmand  la  unbounded  below.  That  a 
quadratic  function  on  any  nonempty  polyhedral  convex  set  either  attains 
its  inflnum  there  or  is  unbounded  below  on  a halfline  of  the  set  is 
given  to  us  by  the  Frank-Wolfe  theorem,  [4,6]. 

In  this  paper  we  shall  present  an  alternative  method  that  also 
accomplishes  this  task  in  a finite  number  of  steps.  Like  that  of  Eaves, 
it  is  mainly  of  theoretical  Interest,  being  computationally  useful  only 
on  problems  that  have  a small  number  of  variables.  Our  approach  %d.ll 
be  to  adapt  the  ideas  in  [7  ] to  obtain  a recursive  procedure,  that  is. 
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one  which  begins  with  a problem  in  n variables,  and  then  reduces  it 
to  a problem  of  exactly  the  same  form  in  fewer  than  n variables. 

Other  finite  methods  for  finding  global  minima  of  quadratic 
programs  (see  for  example  [2])  do  so  by  obtaining  the  best  local  minimum 
and  are  unable  to  detect  whether  or  not  the  constrained  minlmand  is 
unbounded  below. 


2.  Notation 

Let  n denote  {1,  2,  ...,  n}.  For  x G r”  a C n,  let  x G 
— ’ o 

T 

denote  (x^ x^  ) where  o - ...»  a^^},  <•••< 

1 ro^n  ^ 

For  A€r  ,aCm,  SCn,  let  A denote  the  submatrix  of 


A whose  rows  are 

Indexed  by 

a;  let 

^6 

denote 

the  subraatrlx  of 

whose  columns  are 

Indexed  by 

8;  let 

^a6 

denote 

Let  (D,  c.  A,  b)  denote  the  quadratic  program  in  (1)  where 


D e c € r",  a G r“’‘"  and  b G r"*. 

Let  I X I denote  the  end  of  the  procedure. 

3.  Preliminary  Results 

We  require  the  following  elementary  and  well  known  results  which 
we  shall  state  without  proof  (see  for  example  [8]). 

Let  P(b)  be  a polyhedral  convex  set  of  the  form 

P(b)  - {x  G r“:Ax  < b} 
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where  A G In  particular 

P(0)  - {x  G r”:Ax  < 0)  . 

3 . 1 Lemma ; If  P(b)  is  nonempty  then  P(b)  is  bounded  iff  P(0)  » {0}. 

3 . 2 Lemma ; If  P(b)  is  nonempty,  and  frR"*  -»  R is  a strictly  concave 

function,  then 

(1)  f is  unbounded  below  on  P(b)  iff  P(0)  ^ {0};  further,  if 
0 y £ P(0)  and  x S P(b) , then  f(x  + 0y)  -►  -«>  as  0 -»•  “> 

(ii)  if  P(0)  - {0}  then  f attains  its  infimum  on  P(b) ; moreover 
this  Infimum  is  attained  only  at  an  extreme  point  of  P(b). 


3 . 3  Lemma ; Let  x G P(b),  and  let  y - {l:Aj^  x - b^^).  Then  x is 

an  extreme  point  of  P(b)  iff  rank  (A  ) ■ n,  i.e. , A has  full 

y • I • 

column  rank. 

From  Lenna  3.3  we  obtain  immediately 


3.4  Lenma;  There  is  a finite  collection  ^4^  of  subsets  of  m such 
that  for  all  b,  x is  an  extreme  point  of  P(b)  iff  there  is  a y ^ *4^ 
such  that 

(i)  A X - b 
Y-  Y 


3 


C 


1 


(ii)  A ^ exists 
Y • 

(ill)  A,  X < b,  where  6 = m ' y 
o . ~ o — 

In  addition  to  these  lemmas  we  shall  require  a finite  procedure 
for  the  convex  case,  that  is,  when  the  matrix  D in  (1)  is  positive 
semi-definite.  There  are  several  algorithms  (3]  available  for  this 
task,  and  so,  in  what  follows  we  shall  simply  assume  that  the  convex 
case  can  be  (relatively)  easily  solved  in  a finite  number  of  steps. 


4.  The  Procedure 

We  shall  assume  that  the  constraint  set  {x:Ax  £ b}  is  non-empty, 
and  without  loss  of  generality  that  D is  symmetric. 

We  now  proceed  as  follows: 

4.1:  The  case  n = 0.  Here  the  problem  is  vacuous.  Define 
the  optimal  value  to  be  zero  and  attained  at  the  origin  [XI  • 

4.2:  Since  D is  symmetric,  there  exists  an  orthogonal  matrix 
Q (1,  p.  54J  such  that 

q’’^DQ  - Diag  (X^ X^) 

where  the  X^  are  the  real  eigenvalues  of  D.  Setting  D - Diag  (X^,  ...»  X^), 
c “ Q^c  and  A - AQ  we  obtain  an  equivalent  quadratic  program  (D,  c.  A,  b) 
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K « 


r 


in  the  transformed  variables  x,  where  x « Q x.  I.et  n » 2^  0) 

and  H * { i: < 0} . 

4._3;  The  convex  case,  that  is,  when  6 “ By  our  remarks  in 

Section  3,  we  may  assume  this  done  [x]  . 


The  non-convex  case  (B  i ill)  is  the  Interesting  case. 
Since  5 is  diagonal,  we  may  write  the  problem  (D,  c.  A,  b)  as 


minimize: 


subject  to: 


/•I  "Tn  “ j.  “T-  X . /I  - r;  - . -T-  . 
(—  xD  X + CX)  + (Tr  x„D  ,,  x„  + c„x„) 
2 u art  a a a 2 B BB  B B B 


A X + A X < b 
■ a (1  • B S — 


(2) 


The  second  term  in  the  minimand  is  strictly  concave  since  < 0 

for  i G B.  By  Lemma  3.2(i)  the  minimand  is  unbounded  below  if  there 

exists  yo  + 0 such  that  A y < 0.  V«/hether  or  not  such  a y exists 
n . p p ~ p 

can  be  determined  by  solving  a linear  program. 

If  such  a y^  does  exist,  the  minimand  in  (2)  is  unbounded  below 
on  the  halfline  {x  + Hy:G  2 01  where  y ■ (0  y^^)  and  x satisfies 
Ax  £ b.  Therefore  the  minimand  of  the  original  problem  (I),  c.  A,  b) 
is  unbounded  below  on  the  half  line  lx  + 0y:0  2 0}  where  x - Qx  and 

y ■ Qy- 

If  no  such  yp  exists,  then  for  all  x^,  the  set 


R(x^) 


A_pXB  < b 


A 


X 

.a  a 


} 


•) 


Is  bounded.  Tills  follows  from  Lemm.i  3.1.  By  Lemma  3.4  there  is  a 

finite  collection  . t(  of  subsets  of  m such  that  for  each  x , x. 

ah 

is  an  extreme  point  of  there  Is  a ^ . (/  such  that 


and 


\ - 


"1 

A . exists, 

yP 


A X 
yni  a 


(3) 


A-.x  < b.  - A X 
(SB  B “ 6qi  a 


where  6 = m ~ y . 


(4) 


Further,  since  the  constraint  set  in  (2)  is  nonempty,  there  is  an  x^ 

such  that  R(x')  is  nonempty.  Since  R(x')  is  bounded  it  contains 
a a 

extreme  points  and  hence  , (f  is  nonempty. 

Now,  for  each  fixed  y €.  use  (3)  to  eliminate  the  variables 

x„  in  (2).  We  do  this  by  writing 

n 


where 


H^x  + h^ 


- -a“],A 
yP  YOi 


h^  - A~lb 

y6  Y 


(5) 


and  substituting  for  x„  in  the  remaining  constraints  (4)  and  the 

B 

Y Y Y Y 

mlnimand  in  (2).  This  yields  a reduced  problem  (1)  , c , A , b ) in 

the  variables  x , where 
o 


6 


- 5 + (H^)'^D 

aa  pP 


6a 


^ V 


'>’'  ■ >>6  - ^a"''  • 


Note  that  by  substituting  (5)  into  the  minimand  of  (2)  we  also  obtain 
a constant  term 


1 


h’  + 


We  now  apply  the  recursion  to  each  of  the  smaller  problems 
(D^,  c^,  A^,  b^) , that  is,  we  go  back  to  step  4.1  of  this  procedure 
with  (D,  c,  A,  b)  replaced  by  (D^,  c^,  A^,  b^).  Eventually  we 
must  terminate  in  a finite  number  of  steps  at  either  the  case  n »=  0 
or  the  convex  case. 

There  are  now  two  possibilities: 

(i)  For  some  y,  the  minimand  in  (D^,  , A^ , b^)  is  unbounded  below 
on  a halfline  {u^  + Ov^:e  2 0}.  Using  the  relation  (5)  and  imbedding 
this  half  line  back  In  the  constraint  set  of  (2),  it  follows  that 
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is  a liairjint'  of  tliis  constraint  sot  on  whiclt  the  minimanH  in  (2)  is 
unbounded  below.  Transf ormi ns  this  ray  appropriately  using  the  matrix 
Q yields  the  corresponding  ray  of  the  original  set  in  (1)  along 
which  that  minimand  is  unbounded  below. 

Y Y Y Y 

(ii)  For  each  y,  the  problem  (D  , c , A , b ) has  a global  minimand 

Y Y 

W at  some  point  u . 

Set 


p = min  1 } . 

y€.// 


and  let 


K Y y 

Y * argniin  {W  + g } 

y€,  // 


Y ^ Y ^ 

so  that  p “ W + g 


Then  p is  the  global  minimum  of  the  problem  (D,  c,  A,  b)  and  is 
attained  at  the  point 
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This  is  readily  seen  to  be 
back  as  before  yields  p 

■k 

at  the  point  x where  x 
This  completes  the 


a I onsefpji-ncc  of 
the  global  minimum 


procedure . 


Lemma  J 
of  the 


2(ii).  Transforming 
problem  (D,  c.  A,  b) 
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